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(54) . A method for inserting a visual element into an MPEG bit sixeam 



(57) A transcoding method for Inserting a visual el- 
ement into an encoded bit stream with minimal decoding 
of the encoded bit stream. The transcoding method In- 
cludes the steps of receiving an encoded bit stream con- 
taining a picture, partially decoding a copy ol the bit 
stream, determining If a segment of iho picture in the bit 
stream is affected by the insertion of the visual element, 
re-encoding the segment if the segment is affected by 



the insertion of tlie visual element, and outputting the 
re-encoded bttstieam. The encoded and rc-cncodcd bit 
streams may be MPEG-encoded bit streams. The rc- 
encoded bit strea n may be output using a bit rata control 
process thai randomly selects an initial processing point 
within the re-enccided bit stream, requamizesthe re-cn- 
coded bli sirearr using a modified quantiration table, 
and/or utilizes a slice-level stopping criteria for selec- 
tively starting or onding bit rate control. 
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Description 

[0001 1 The invention generally relales lo a process for 
modifying coded bii sircams More panicularly, ihe in- 
vention IS directed lo a process tor insening a visual el- 
emeni into a moving pictures group-iype 2 ("MPEG 2") 
encoded video bii stream 

[0002] Traditionally broadcast stations insert visual 
elements (eg , logos, station identifications, video se- 
quences, and the like) into video signals broadcast to 
the end viewer. Before the advent of compressed video 
stream transmission, the inseaion of a logo into a broad- 
cast was a relatively straight forward procedure of su* 
perimposing or substituting the logo Image over a se- 
lected portion of a video frame. However, with the ad- 
vent of compressed video stream transmission (eg.. 
MPEG -coded video streams) the insertion of logos into 
video broadcast has become complicated due to tem- 
poral dependencies in the coded video stream. In par- 
ticular, each frame in the video stream no longer con- 
tains all the information necessary to reconstruct the vid- 
eo image. Rather, only a few frames (eg., I frames) In 
the video stream contain all the information that is need- 
ed to re-construct a video image. Other "predictive" 
frames (e.g.. P frames and B frames) reference the por- 
tions of the complete frames (e.g., I frames) that are nec^ 
essary for the reconstruction of the predictive frames, 
as discussed in further detail below. 
[0003] One method of insetting a logo into an MPEG- 
coded video stream is to decode the video stream, insert 
the logo In the pixel domain, and rc-cncode the video 
stream. However, the process of decoding and re-en- 
coding the entire video stream has several drawbacks. 
One drawback is that the decoding and re-encoding 
process results in a loss in image quality since errors 
are introduced into the video stream. These errors are 
due. tn patt. to the non-re versiblc nature of some of the 
coding techniques (e.g.. quantisation and Inverse quan- 
tisation). Another drawback is that decoding and re-en- 
coding the entire video stream requires a sicinificam 
amount of computation. 

[0004] In addition to the drawbacks discussed above, 
there IS an additional difficulty encountered when insert- 
ing a togo into an MPEG-encoded video stream. The 
insertion of the logo may affect the bit count of the video 
stream. In particular the insertion of the logo may cause 
the bit count of the video stream to increase or decrease 
and this. In turn, may affect Video Buffer Verifier (VBV) 
compliance. More specifically, the input buffer of a de- 
coder, under the MPEG standard, has a ft)(ed buffer size 
and handles transitions between a constant channel bit 
rate. i.e.. the rate at whk:h the video is displayed, and a 
fluctuating MPEG coded bit rate, i e , the rate al which 
the compressed video is passed Preferably, data flows 
through the buffer so underflow and overflow conditions 
are avoided. However, altering the bit count of the 
MPEG-encoded video slreum m&y cause underflow or 
overflow conditions to occur in the input buffer of a 
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downslream deccder. 

[0005] The pre^.ent invention is directed to overcom- 
ing the drawback:* and diffk^uliies discussed above. 
[0006] Briefly slated, a transcoding nr^thod for inseri- 

^ ing a visual elemeM into an encoded bit stream with min- 
imal decoding of the encoded bit stream is provided. The 
transcoding method includes the steps of receiving an 
encoded bii stream containing a picture parltally decod* 
ing a copy ol the t'll stream, determining il a segment of 

(0 the pk:lure in the bit stream is allcctcd by the ir^ertion 
of the visual clenent. re-encoding the segment if the 
segment is affected by the insertion of the visual ele- 
ment, and outputt ng the re-encoded bit stream The en- 
coded and re-enc oded bit streams may be MPEG-cn- 

is coded bit streamn The re-encoded bit stream may be 
output using a bit -ate control process that randomly se- 
lects an initial proi:essing point within the re-encoded bit 
stream, rcquantises the re-encoded bit stream using a 
modified quantization table, and/or utilizes a slice-level 

20 stopping criteria f i)r selectively starting or ending bit rate 
control. 

[0007] In one c.dvantageous embodiment of the in- 
vention, a transc<iding method for inserting a visual el- 
ement into an enc-oded bit stream representing a series 

25 of image frames is provided. The transcoding method 
includes receivinci the encoded bit stream, partially de- 
coding the encoded bit stream, inserting the visual ele- 
ment into the par'ially decoded bit stream, re-encodlng 
the partially dccoiied bit stream after the visual element 

so is inserted, and ojtputting the re-encoded bit stream. 
[0008] In another advantageous embodiment of the 
Invention, a transi^oding method for inserting a visual el- 
ement into an ins>m'ion region of an encoded bit stream 
representing a series of inriage frames is provided. The 

35 transcoding inchides receiving a first encoded bit 
stream, decoding a copy of the first encoded bit stream 
to deienntne a po>ition of a segment of an image frame, 
comparing the Inserrion region to the position otthc seg- 
ment to determin*; if the insenion of the visual element 

^ would affect the .segment, re-encoding the segment iS 
the insertion of the visual clement affects the segment, 
and ouiputl'ng a second encoded bit stream, the second 
encoded bit stream being a combination of the first en- 
coded bit stream and the re-encoded segment 

^5 [0009] In a further advantageous embodiment of the 
invention, a transcoding method for inserting a visual el< 
ement into an ins mton region of an encoded bit stream 
is provided. The t anscoding method includes receiving 
a first encoded bit stream representing an image, de* 

^ coding a copy of the first encoded bii stream to deled 
charactcnsiics ol respective segments of the image, 
comparing the ch iracterlstlcs of the segments to the in- 
sertion region to detemiine if the inscnion of the visual 
element into the mage would affect the segments re- 
encoding the affe^ed segments, and outputting a sec- 
ond encoded bit stream such thai the second encoded 
bit stream contair s the same number of bits as the first 
encoded bit strean, the second encoded bit stream be 
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ing acombinATion of ihe first encoded bit ^rrecim and The 
re -encoded scgnnents 

BR I EF Og=SCRlPTION OP FHE DRAWINGS 

[0010] The aforennemioned advantages of me inven- 
tion, as well as addiltonal advaniagcs thercol, wiii be 
more fully undcrslood as a result o( a dclailcd dcscrip- 
lion of ;he preferred cmbodfmcnl when lakcn in conjunc- 
tion with the accompanying drawings in which 

FiG. 1 illusu^tes an exemplary image and logo of 
the present invention; 

FIG. 2 is illustrates pixel macrobiock slices, mac- 
roblocks. and bk)cks in the FIG. 1 image; 
PIG. 3 is a block diagram illuatrsilng a logo insenion 
process of the present invention; 
FIG. ^ IS a IS a flow diagram illustrating a by-pass 
process of the present invemton; 
FIG. 5 ts a f lowchan illusiraiing a frame determina- 
tion process of the present invention; 
FtG. 6 is a flcwchan illustrating a logo insertion 
process for an I frame of the present inventipn. 
FIG. 7 is a flowchart illustrating a logo insertion 
process for a P frarne of the present invention. 
FIG. 8 ts a flowchart illustrating a logo insertion 
process for a B frame of the present invention: and 
FIGS. 9. 10 and 11 are flowcharts illustrating a rate 
control process of the present invention 

[0011] The characteristics afid advantages of the 
present invention will become nriore apparent from the 
following description, given by way of example. 
[0012] Referring now to FIG. 1 , an exemplary image 
1 0 and logo 1 2 are shown . image 1 0 may be contained 
in a field picture or a franne picture having an I P, or 6 
structure. For cianiy and ease of reference, only frame 
pictures wi)| be discussed below. An insertion region 1 4 
in image 10 corresponds to the position where logo 12 
IS TO be insened. As briefly mentioned above, a frame 
having an f structure is similar to a frame coded as a still 
image. As such, an I frame contains an thp nc^ccssary 
image duia needed for the reconstruction of the image 
contained within it. A frame having a P structure is 
known as a predicted frame and requires, for recon- 
struction, the image datd comained in the most recently 
reconsinjCTed I or P frame. A frame having a B structure 
is known as a bidirectionni frame and is predicicd from 
the Closest two 1 and/oi P frames, one m the past and 
one in the future Therefore, a B frame requires the im- 
age data contained in two other frames (I and/or P) for 
reconstruction. 

[0013) Referring now to FtG 2. image 10 is encoded 
as ai^ I P, or D frame and passed in an encoded bil 
stream as a series of macrobiock slices 16 tach mwc- 
roblock slice 1 fi conmins luminance and chroma dafa 
lor a hori/ontal group of pixel macrobiocks 18- Each pix 
el macrobiock 1 e has a size of 1 6x1 6 pixels (not shown) 



and IS made up o' lour blocks 20 of luminance and Iwo 
blocks of chrominance (one Cr and one Cb) covering 
the same area *"hus a iranscodcr implementing the 
method of ihc prjseni invention receives an encoded 

& video bil slrcam us a series of macrobiock slices 16. Al- 
though an exemplary transcoder is not shown the im- 
plementaiion of tfie present Invention m a conventional 
MPEG transcode * is considered within the ability of one 
skilled In the art. 

»o [0014] Refemng now lo FIG. 3. in conjunclion with 
FIG. 2. an overall logo inseaion process 22 of the 
present invention Is shown. Logo insertion process 22 
includes a logo insertion pass 24 and a r;)tc conlrol pass 
26. As discussed in further detail below, logo insenion 

>5 pass 24 includes a decoding step 28 and a re-encoding 
step 30 Generally, decoding step 28 includes partially 
decoding an incoming encoded video stream and deter- 
mining if a segment (e.g., macrobiock slice 16, macrob- 
iock 18, or a block 20} of the video stream overlaps or 

20 is oLhenwise affecied by the insertion of logo 12. If the 
segment is not affected by the insertion of logo 12. the 
encoded segment by-passes decoding step 28 and re< 
encoding step 3C and is stored in a temporary buffer 
However, if the ssgmeni (e.g.. macrobiock slice l7) is 

is affected by the in sertion of logo 12. the affected portion 
of the segment, dunng decoding step 28. is decoded up 
to the pixel domain and logo 1 2 is combined with, or oth- 
envise assimilated into, the affected portion of the de- 
coded segment. Aften^vards. during rc-encoding step 

30 30, the segment, now containing logo 1 2 or logo related 
data (e.g. . motion vector infonmation), is re-encodcd and 
stored in the tern )orary buffer 
[0015] Next, during rale control pass 26. the encoded 
and re-encoded <.egments of the video stream are out- 

35 put from The temporary buffer such that the re-encoded 
segments are inssrted into their original positions in the 
encoded video stream. During a decoding step 32, the 
segments of the oncoded video bit stream are decoded 
up to the DCT dOTiain. in the OCT domain the OCT co- 

40 efficients of the sagmcnis are requanti?ed using differ- 
ent quantization :;calars, as discussed in further detail 
below. After requcinti>ation, ihe decoded segments, dur- 
ing a rc-encodint| step 34, are re-encoded and stored 
in a temporary buffer. The re-cncoded segments are 

^5 then output via a selective rate control that is enabled 
or disable based on characteristics of the rcquantized 
segments, as dis:ussed in further detail below 
[0016] Although logo insertion pass 24 is iltustrntcd 
as being distinct Irom rale control pass 28.. one skilled 

so in the art will rea'Jily devise that logo insertion pass 24 
may be integrated with the rate control pass to further 
reduce the computational cost of the overall logo inser- 
tion process 22 However logo insenion pass 24 and 
riile comrol pass ?6 are illubtraied as distinct passes lor 

55 cienty, ease of rrfcrcnce.. and to facilitale an under- 
standing of the p esenl invention 
[0017] Referring now to PIG. 4 m conjunction with 
f iG 2. a partiali> decoding process 38 of the insertion 
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method o( Ihe present mvenlion is illu^^tratcd Data in an 
incoming bit stream 40 is passed ihiough a transcoder 
al the highcsi level possible For example, nn encoded 
macrobiock slice 1 6 ihal docs not overlap, oi is not oth- 
erwise affected by, insertion region 14 of logo 12 is 
passed through The iranscodcr in the macrobiock slice 
domain 46 and stored as an encoded macrobiock sUce 
If a portion of a macrobiock slice (eg. macrobiock slice 
1 7) IS found to overlap or to be otherwise aflccted by. 
the logo's insenion region 14 the macrobiock slice Is 
decoded into the macrobiock domain 48 and any mac- 
roblocks 18 that don'l overlap the logo's Insertion region 
14 are passed through the iranscoder m the macrobiock 
domain 48 and stored as encoded macrobiocks. Fur- 
ihemnore, in the macrobiock domain ^8 any motion vec> 
tors affected by the logo's insertion region 14 are proc- 
essed, as discussed in funher detail below. This by- 
passing process continues up to pixel domain 44 where 
the pixels In the overlapping portion of the macrobiock 
slice are combined with logo 12 Adcnvards. the pixels 
arc re-encoded down to macrobiock slice domain 46 
such that encoded and re-encoded blocks are combined 
into re-cfncodcd macrobiocks. encoded and re-encoded 
macrobiocks are combined into re-encoded macrobiock 
slices, and encoded and re>encoded macrobiock slices 
are passed in an outgoing bit stream 42. Thus, partially 
decoding process 38 of the present invention facilitates 
Ihe insertion of logo 1 2 into an MPEG bit stream 40 with- 
out fully decoding the entire bit stream and. as a result, 
reduces the complexity, cost, time, end re-coding loss 
traditionally encountered during logo insertion. 
[0018] Referring now to FIG. 5, a general oven/iew of 
the visual element insertion process 50 is illustrated. As 
illustrated, at step ^2. the transcoder examines an in- 
coming frame to determine if the frame is an I frame, if 
so. the transcoder. at step 54, carries out the process 
illustrated in FIG. 6 If not. the transcoder, at step 56, 
determines if the incoming frame is a P frame. If the in- 
coming frame is a P frame, the transcoder. at step 58. 
carries out the process illustrated in FIG. 7. If the incom- 
ing frame is not a P frame, the transcoder. at step 60. 
determines that the incoming trame ts a D frame and 
cam'es out the process illusiraied m FIG 8. Frame type 
maybe deiennined by examining picture or frame head- 
er cJala accompanying respective coded frames As dis- 
cussed in further detail below, after the visual element 
has been inseiled into the incoming frame, the Trans- 
coder, at step 62. repeats the process illustiated in riG. 
5 to determine the frame type ol the next incoming 
frame. This process continues until the insertion of the 
visual element into the incoming bit stream is complet- 
ed 

[0019] Relerring now to FiG. 6. an I frame inscnion 
process 70 is shown Fiisi. at step 72. the iranscoder 
stores and copies The encoded bits of a macrobiock slice 
ol the incoming hframe Next, at step 74. the transcoder 
decodes the copy of the encoded bits of the macrobiock 
slice and stores two copies of the decoded slice m mem- 
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cry The first copy is stored in a "Rcf (sliCG_pos)" block 
of memory The d4:codcd macrobiock slices stored in the 
"Ret (slicc.pos)" block ol memory niay be utilircd for 
decoding macrobiocks m later frannes as ts done in a 
5 standard MP£Q decoder. The second copy is stored in 
a "Ref^wjogo (s!lce_pos)" block ol memory and may 
be utilized for re-oncoding macrobiocks in later frames 
that are affected ^y the logo insertion, as discussed in 
further detail betciw. At step 76. the transcoder deter- 
to mines whether ths decoded macioblock slice overlaps 
the logo's insertio ^ region 14. if not. at step 76, the trans- 
coder passes the encoded bits of the macrobiock slice 
that were previously stored. If so. at step 80, the trans- 
coder combines the overlapping ponions of logo 1 2 and 
1$ the macrobiock slice (e.g.. macrobiock slice 1 7). as dis- 
cussed above, and overwrites the previous content of 
the "Ret,„.w..logo slice.jjos)" block of memory with this 
new data, it should be noted that the combining step 
may represent, but is not limited to. a replacement or 
20 mixing operation. It should be further noted that logo 1 2 
may advantageously be in encoded form (e.g.. an en- 
coded macrobiock] il the combining step Is a replace- 
ment operation s ince replacing the macrobiock slice 
with macrobiock portions of logo 12 in the macrobiock 
2s domain requires less computation than replacing the 
macrobiock slice with pixel ponions of logo 1 2 in the pix- 
el domain. To further reduce unnecessary computations 
the logo insenion region 14 may be sized to align with 
upper and lower lioundaries of overlapping macrobiock 
30 slices (o ensure that the entire logo replacement oper* 
ation occurs in the macrobiock domain. At step 82 the 
transcoder re-Qn<:odds the combination of logo 12 and 
the overlapping macrobiock slice and, at step 84, pass- 
es the rc-encodcd combination, as discussed above. 
35 DC quantisation values undergo OPCM (Differential 
Pulse Code Mo(luiaiion) across a macrobiock slice 
Thus, a macrobiiick to the right of a re-encoded mac- 
robiock (i.e.. the riacrobtock combined and re-encoded 
with a portion of logo t2) must also be re-encoded to 
■fo account for the change in the DC quantization value of 
the macrobiock containing the logo. Next, at step 86, the 
transcoder delen'iines whether the cun^ent macrobiock 
slice IS the last mucrobiock slice in the I frame. If not. at 
step 88, the transcoder returns to step 72 to store and 
^5 copy the next en(:oded macrobiock slice of the I frame 
If so. at step 90, the transcoder returns to the process 
illustrated in FIG 5 and begins to examine the next 
frame. 

[0020] Referring now to FIG 7. d P frame insenion 
so process 92 is shown First, at step the transcoder 
stores and copies the encoded biis of a macrobiock slice 
of the incoming P frame Next, ai step 96, the transcoder 
decodes Ihe copy of the encoded bits ol the macrobiock 
slice and stores Iv/o copies Ol the decoded slice in mc>m- 
55 cry. The first copy is stored in a "Pef (slice .pos)" block 
of memory. The diicoded macrobiock slices stored m the 
"Ref (slice^posr block of memory may be utilized for 
decoding macrotlocks in later frames as is done m a 
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siandard MPEG decoder. Allhoucih complelcly decod- 
ing P f rame segmems is disclosed, ii is considered with- 
in ihc scope of The present invention to use other tech- 
niques for re* encoding luier frames lhal are ;)tfectGd by 
the inseilion of logo 12 For cx»mplG. the transcoder 
m^y store encoded P frames and decode selected pans 
of Ihc P f ranne on an as needed basis The second copy 
>ssiaredina''Ref w logo (slice pos)" block ot nriemory 
and may be utilized for re-codtng macrobiocks In later 
frames that are affected by logo insenion. as discussed 
in further detail below. 

[0021 ] At step 98 the transcoder determines whether 
the position ot the second copy of the decoded macrob- 
lock slice overlaps the logo's mserHon region 14. H so, 
at step 100, The transcoder connbines the overlapping 
portions ot logo 12 and the macroblock slice (e.g.. mac- 
roblock slice 17) and overv/hies the previous conlcnl of 
the "Rcf^w Jogo {sllce_pos)" block of memory with this 
new data. Aftenwards. at step 102. the transcoder re- 
encodes the combination of logo 12 and the overlapping 
macroblock slice using a previously encoded anchor 
frame (c.g . l-lrame or P-frame) thai contains the logo 
and, at step 704, passes the re-cncodcd combination, 
as discussed above. As previously noted, the combina* 
lion may represent, but is not limited lo, a replacement 
or mixing operation. In an alternalive approach, the 
transcoder may sol a motion vector, associated with the 
overlapping macroblock. to 2ero to avoid the computa- 
tional cost of the motion vector search process. In either 
case, it should be noted thai the motion vector and DC 
quantization values are DPCM across a macroblock 
slice. Therefore, if a motion vector and/or macroblock is 
re-encoded the next unskipped motion vector and/or 
macroblock must be difierentlally encoded to account 
for the re-encoding of the motion vector and/or macrob- 
lock. 

[0022] If the transcoder determines that no overlap 
exists the transcoder at step 106. determines whether 
there are any motion vectors In the macroblock slice that 
point lo the logo's inscrlion region 14. If not, al slop 108, 
the transcoder passes the encoded macroblock slice 
that was previously stored, it so. at step ilO the trans- 
coder preferably re-encodes the affected macroblocks 
using the reference frames that were previously saved 
in the "Rel w/ logo'* block of memory As discussed 
above the previously stored macroblocks are macrob- 
locks of earlier I or P frames that were stored and mod- 
ified by logo insertion In an alternative procedure, the 
transcoder may set motion vectors pointing lo the logo 
insertion region 14 lo zero This alternative procedure 
wouti reduce Ihc computations othenrvise needed for 
re encoding the affected macroblocks Furlhenr^orc. 
motion vector ewrapolation techniques may also be uti- 
\\7M to reduce COtnpuiaiion costs. One exemplary mo 
tlon vector extrapolation technique is disclosed m appli- 
cant's U S Patent Applcalion Ser No 026.140. Hied 
February 20, 1998. entitled "Wonon Vecror Exirapcte- 
lion For Transcoding Video Sequences" and hereby in 



corporated hereir by reference In any case, it should 
be notedthat the motion vector and DC quantisation val- 
ues are OPCM across a macroblock slice. Therefore, if 
a motion vector and/or macroblock is re-encodcd the 

^ next unskipped aiollon vector and/or macroblock must 
be differentially encoded lo account for the rc-cncoding 
of the motion vector and/or nnacrobiock. At step 1 0^ the 
Iranscoder passes the re -encoded macroblock slice. 
[0023] Afler the stored macroblock slice or rc-cncod- 

to ed macroblock s icc is passed, (he transcoder deter- 
mines at step 112, whether the current macroblock slice 
IS the last macroblock slice In the P frame. If not, at step 
114, the transcod sr returns lo step 94 lo store and copy 
the next encoded macroblock slice inihe P frame. If so 

'3 at step 1 1 6 the Irimscoder returns to the process of FIG. 
5 and begins the examination of the next frame 
[0024] Referring now lo FIG. 8. a B frame Insertion 
process 11B is shown Initially at step 120. the trans- 
coder stores and copies the encoded macroblock slice 

^0 of the incoming El frame. Next, at step 122. ihe trans- 
coder determines if insertion region 1 4 of logo 1 2 is with- 
in the f-code ranee of the macroblock slice. The f-code 
range is contained in the picture header If not, at Step 
124. the transcoder passes the stored macroblock slice 

•?5 and determines. \\\ step 1 26, whether the current mac- 
roblock sicc is th 2 lasl macroblock slice In the B frame. 
If the current mac oblock slice is not the last macroblock 
slice in the B frasnc then, ai step 128, the transcoder 
returns to step 1 20 to- store and copy the next encoded 

30 macroblock slice in the B frame, ff the current macrob- 
lock slice is the la:»t macroblock slice in the B frame then, 
at step 130, the transcoder returns to the process illus- 
trated in FIG. 5 aid begins the examination of the next 
frame. 

25 [0025] If insert! v\ region 14 of logo 12 Is within the f- 
code range the t anscoder, at step 132. determines if 
the macrobtock si ce overlaps insertion region 1 4 of logo 
12. It so at step 34. the transcoder decodes the mac- 
roblock slice and, al step 136, combines The overlapping 

*o portions of the macroblock slice (e.g. . macroblock slice 
1 7) and logo 12. /iftenArards. at step 1 38, the transcoder 
re-encodes the combination of logo 12 and the overlap- 
ping macroblock slice using previously encoded anchor 
frames (e.g.. I frames and/or P-framcs) thai contain lo- 

<^ QO 12 and, at ste? i ^0, passes the re-encoded combi- 
nation As previojsiy noted, the combination may rep- 
resent, but IS not Imitcd to, a replacement or mixing op- 
eration In an alternative approach, the transcoder may 
set the motion vectors associated with each overlapping 

so macroblock to zero lo avoid the conpurational cost ol 
Ihe motion vector search process. In either case, as dis- 
cussed above, the next unskipped motion Vector and/ 
or macroblock musi be dirrorcnnaliv encoded. 
[0026] u, ai sie 3 1 32, the Iranscoder deieimines ihai 

S5 the macroblock slice does not overlap insen»on region 
14 of logo 12, the transcoder. ai step 1^2, acquires the 
motion vectors fcr each macroblock in Ihe macroblock 
slice. Next, at sti:p 144. the transcoder detenYimcs if 
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there are any moiion veciois That point to insenion re- 
gion 14 of logo 12. It not. at srep 124, the iranscoder 
passes the encoded macrobiocK slice ihm was previ- 
ously stored and. at step 126 deiet mines if the current 
nfiacroblock slice is the last macroblock slice In the B 
frame. t( there are motion vectors pointing to the inser- 
tion region the transcoder at step 146. decodes the rel- 
evant portion of the mpicrohlock shoe (i c. the macrob- 
iocks having the relevant motion vectors) and, Hi step 
138, preferably re-cncodcs the allcclcd reference 
frames that were previously stored in the "Ref w/ logo** 
block of rncmory. As discussed above t)ie previously 
stored macroblocks are macrobtocks of earlier I or P 
frannes that were stored and modified by the logo inser- 
tion, tn an aUernativc procedure, the transcoder may ex- 
amine the-motion vectors (torward and backward) of 
each macroblock to determine if a motion vector that 
doesnl point to insertion region 14 exists, if sucri a mo- 
tion vector is detected, the transcoder may discard all 
other motion vectors for the macroblock. In another al- 
ternative procedure, the transcoder may set the motion 
vectors of each affected macroblock to zero. Both alter- 
native procedures would reduce the computations oth- 
erv/ise needed tor re-encoding the affected macrob- 
locks. In an)/ case, as discussed above, the next un- 
skipped motion vector and/or macrobiocK must be dif- 
forcnlially encoded. Aftenwards, at step 140, the trans- 
coder passes lYie re-encoded macroblock slice and, at 
step 126. determines whether the current macroblock 
slice is the last macroblock slice In the B frame. 
[0027] Referring now to FiGs. 9. lO, and 11 , the rate 
control pass 26 of tho present invention is shown in fur- 
ther detatl. As discussed above, the aSfccled segments 
of an incoming encoded bit stream are partially decoded 
and re-encoded for logo insertion prior to rate control 
pass 26. More specifically, the affeaed region for I 
frames is that region containing slices that overlap the 
logo insertion region 14. For P-and-B frames, the affea- 
ed region is the region encompassing slices which con- 
tain macroblocks that overlap, or have motion vectors 
pointing to. the logo insertion region 14. As a result, the 
outgoing bit stream may not have the same bit count as 
the original incoming bit Stream. However, maintaining 
the same bit count for the input and output bit streams 
is desirable tor a number of reasons. One ro.nson is that 
if the same bit count is m^sintamed for each frame (e.g.. 
I, P. or 6 frame), the transport stream header can be re- 
used for the outgoing bit stream since data in the header 
(e g.. DTS data, PTS data, etc. ) will not change. An- 
other reason is that the VBV compliance of an incoming 
bit stream will be maintained tor an ouigomg bit stream 
if the bit count for the fromcs ot both bii streams Is the 
same. Thus rate control pass 26 permits the re-use of 
the transport stream header and maintains the VBV 
compliance of the video bit stream However, ii should 
be noted that rate conirol pass 26 is an exemplary rate 
control process of the present invention and that other 
rate control processes may be used to facilitme trans- 



pon stream headijr re-use and/or VBV compliance with- 
out depanmg from the spirit and scope of the present 
invennon. as deti led in the appended claims. 
[0028] Turning now to FIG 9. the transcoder inflially. 

^ at step ISO, comoules the bit count of a frame in the 
original input bit : Iream, i.e. the bit count of the frame 
in the video bit st'eam prior to the insertion ot logo 12. 
Next, at step 1 5? , the transcoder computes the bil count 
of a correspondin 3 frame in the output bil stream affecl- 

10 ed by the insertion of logo 12 as well as the bit counts 
ol the macroblock slices of the corresponding frame At 
step 1 54 the trans coder calculates the difference (delta) 
between the bit :ount of the frame in the output bit 
stream and the input bil stream. Delta represents the 

JS number of bits that the output bit stream must be re- 
duced by or increased by to ensure that the number of 
bits of the frame tposl logo insertion) in the output bit 
stream is equat tci the number of bits of the frame (pre 
logo Insertion) in the input bit stream At step 156 the 

^ transcoder detennin es if delta is negative if delta is neg- 
ative the number >f bits in the input bit stream is greater 
than the number ')f bits in the output bit stream and the 
transcoder. at ste 3 168, inserts dummy bits into the out- 
put bit stream to ensure Ihat-lhe output bit stream is 

^5 equal to the inpu. brt stream. Aflenwards, at step 160. 
the transcoder oi tpuis macrobtock slices of the re-en- 
coded frame. 

[0029] If delta is not ncgafhrc the transcoder, at step 
162, determines if delta is zero. When delta is 2ero the 
30 number of bits ir the input bit stream is equal to the 
number of bits in the output bit stream and the transcod- 
er. at step 164, 01 tputs macroblock slices without using 
rate control 

[0030] Turning now to FIG. 1 0, if delta is posAive the 

35 transcoder, at stei) 1 66, randomty selects a starting slice 
position for bit ra;e control. When delta is positive the 
number ot bits in the output bit stream is greater than 
the number of btf:» in the input bit stream and the trans- 
coder must reduce the number of bits in the output bit 

^0 stream. By randoTify selecting a stanmg slice position, 
the Iranscoder minimizes perceptual problems (e.g. cy* 
die patterns or breathing errors) that are generated 
when the same iritial slice location is constantly distort- 
ed. However, it i.; considered within the scope of the 

•^s present invention lo process the macroblOCk slices in a 
fixed or sequentifc I manner. Next, at step 168. the trans- 
coder retrieves the selected sHce from the memory buff* 
er and decodes the selected slice up lo the OCT domain. 
Aftenvards. the 'ranscoder at slop 170. adjusts the 

^0 Quamization scaiiss of each macroblock in the decoded 
s)ice and.- at stei; 1 72, rcquanii/es the OCT data of the 
macroblocks in Hie decoded slice. The adjusimem in- 
volves dividing th > OCT cocflicienls by a predetermined 
integer and mutt plying the quantizaiion scale by the 

55 same predetermined integer The prederermined inte- 
ger may be a fixel integer thnt remains conslant during 
the processing o- the macroblock slices m the current 
frame Anemaiivuty ihe predetemtined integer may be 
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a vai'iabte integer ihat increases in magnitude as The 
number oi processed slices (or the current trame in- 
creases. Increasing \he magntiiide of the predeterniined 
imeper on a slice by slice basis reduces ihc compuia- 
lional complexity and processing time torconirolhng the 
bit rate of ^ach frame since the number of macroblock 
slices that are processed, via rale control, is reduced 
One exemplary adjuslment. using a fixed integer is 
halving the DCT cocfficienis and multiplying ihe quami- 
zaiion scales by a factor of two Halving the DCT coef- 
ficients generally reduces the bit counl since smaller co- 
efficient values tend to require shorter codes. To restore 
the coetficients to their approximate value the quantiza- 
tion scales arc multiplied by a factor of two prior to re- 
quantization. At step 1 74 The transcoder recncodes the 
requamized OCT data into a video bit stream and. at 
step 1 76, outputs the bil stream 
[0031] Turning now lo FIG. 11 , rate control pass 26 
conlinues wvith the transcoder, at step 1 78. maintaining 
a record of the bit count of an outgoing slice and calcu- 
lating the difference between the bit count of the original 
slice (prior to re-quanti^aiion) and the current stice (post 
re-quaniizaiion) at a lirst predetermined position (e g., 
midway through the slice). Next, at step T60 the trans- 
coder detennines if the calculated difference is greater 
than or equal to the delta value previously calculated. If 
so, the transcoder. at step 182. ends the rate control for 
the cunrenl frame and passes the rest of the frame using 
the original quantization values. The rate control is end- 
ed because the number of bits output in the current 
frame (i.e., post tog insertion) is less than or equal to The 
number of bits in the original frame (i.e . pre logo inser- 
tion). It should be noted that dummy bits may be inserted 
into the output bit stream as needed. If the calculated 
difference is lesis than the delta value previously calcu- 
lated, The Transcoder. at step 184, continues to process 
the slice via rate control. Next, at step 186. the trans- 
coder calculates, at a second predetermined posHron (e. 
g.. at ihc end of Ihe slice), the difference betvtfecn the 
bit counl 01 the original slice (prior lo re-quantization) 
and the currenl slice (post re-quanli/alion) At step 1 88 
the transcoder determines if the calculated difference is 
greater than or equal to the delta value previously cal- 
culated. If so, the transcoder. at step 1 90. ends the rate 
control for the current frame and passes the rest of the 
frame using the original qunnlizalion values The rale 
control is ended because the number of -bits oulpul-in- 
the current frame (post log insertion) is less lhan or 
equal to Ihc number of bits in the original frame (pre logo 
insertion) Again, it should be noted that dummy bits 
may be insencd into the outpui bit stream as needed If 
the calculated difference is less lhan Ihe delta value pre- 
viously calculated, the transcoder returns lo step 1 68 
and begins to process the next slice via r»le control. 
[0032] A diSTOiTion may be iniroduccd when a mac* 
roblock IS rcquanli^ed. This disiortion-wiii-piopagate-lo 
anyother macroblock block usirig ihe rcquanii^ed mac- 
roblock for motion compensation This distortion is not 



significant, but tor some applications compensating lor 
the disionion may be desiied To compensate, subse- 
quent macroblock s poinlmg to the rcquantized region 
will have to be re*encoded. in a manner similar to the 

5 one previously described for logo insertion. 

[0033] While l^c present invenlion has been de- 
scribed with refenmce to the preferred embodiments, it 
IS apparent that that various changes mdy be made in 
the embodiments without depamng from the spirji and 

to Ihe scope of the invention, as defined by the appended 
claims 



Claims 

15 

1 . Method for transcoding by insening a visual ele- 
ment into an encoded bitstream representing a se- 
ries of image frames, including the steps* 

^ - receiving the encoded bitstream. which in par- 
ticular is encoded in accordance with the 
MPEG standard: 

- partially decoding the encoded biisTream; 

- inserting he visual element into the partially de- 
25 coded bitstream: 

- re-encod ng the partially decoded bitstream af- 
ter the vi 5ual element is inserted; 
outputtin'9 the re-encoded bitstream. 

M 2, iMelhod acco tfing to claim i , yi/herein the visual el- 
ement is one of a logo, a textual display, nn image, 
and a video S equence. 

3. Method acco ding to claim 1 or 2. wherein the step 
35 of partially decoding includes the step of decoding 
a segment o an image frame in the encoded bit- 
stream if the segment is affeaed by the insertion of 
the visual clement. 

<<o 4. Method acco ding lo claim 3 wherein the segment 
is one of a nracroblock shoe, a macroblock, and a 
block. 

5. Method according to one of claims 1 to 4 wherein 
the step of inserting Includes substituting the visual 
element for ir lage data in an image frame, or mixing 
the visual elsmeni with image data in an image 
frame. 

50 6. Method acccfding to claim 5, wherein the step of 
substituting (he visual clement tor the image data 
occurs in the pixel domain or in the macroblock do- 
main 

53 7. Method according lo one? ol cleiims 1 lo 6. wherein 
Ihe ouipui bil rcite of the re -encoded bitsncam is 
conirolled SUih ihat each frame m the re-encoded 
bilslream cor tains the same number of bits; as each 
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corresponding frame in the encoded btisiream. 

8. Method according to claim 7, wherein conirolling 
the output bit rate includes the eieps of 

5 

calculating a first bit count for a frame in the en- 
coded bitstream: 

calcuifiting a second bit counl for a correspond- 
ing frame in Ihe re-encoded bitstream; 

• calculating a difference beiween lbs first bit 'o 
count and line second bit count: 

- modifying the bit rate of the re-encoded bit- 
stream lo eliminate the caiculaied difference in 
bit count from the re-encoded bireiream, and. 
in particular, ending the modification of the bit 
rate once the calculated difference in bit counl 
is eliminated. 

9. Method according lo dalm 8, wherein the siep of 
modifying the bK rate tndudes the stepa of: so 

adjusting a quantisation scale factor of the rc- 
encoded bitstream; 

re-quantising portions of the re-encoded bll- 
sfiream in accordance with the adjusted quan- 
tisaifon scale. 

10. Method according to claim 9, wherein the distortion 
introduced by the re-quantisaiion is compensated 

for by re-encoding subsequent affected regions. so 

1 1 . Method according to one of claims 8 to 1 0, wherein 
the step of ending the modification includes the step 
of determining whether the calculated difference in 

bit count is eliminated at a predetomilncd point in 35 
the re-encoded bitstream, wherein, in particular, 
said predetermined point is a midpoint or an end- 
point of a macrobtock slice. 

1 2. Method according to one of claims 6 to 1 1 , wherein 40 
the step of modifying the bit rate includes ihe siep 

of randomly selecting a sianlng point within the 
frame lo begin ihe modification of the bit rale 

45 
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